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ABSTRACT 

v * ? The future role, and importance of educational 

evaluation are analyzed in terms of the Educational Consolidation and 
.Improvement. Act (1981), a block grant whose provisions minimize 
planning, Reporting)* evaluation *apd accountability requirements to 
ensure that national goals' are met. The background in federal and 
state evaluation programs'is discussed, including the Title I * 
Evaluation and Reporting System H TIERS )% The rationale .fot block 
grant programs, the advanta^fes arid disadvantages, "and* the basic forms 
of evaluation and. accountability in 4 t he law are presented. Within the 
impact and future directions of evaluation, concern is*whethe$ the 
lack of specificity in block grant legislation is Qot a* deliberate 
attempt to divest federal funding tot education wheij authorization 
ends in 1987. £ive tenets arc* presented! for' a block grant ^evaluation 
framework advocated by the Council of Chief St?te School Offices to 
ensure tKSt a common core of evaluative data will be available at 
state and national levels. .(AuthorylCM) "\ 
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Background > \ [ < ) *'- ■••/•• 

^valuation as"a discipline has unctecpne many fo'rmativ^ iterations. As J. 6. Merwin observes, 
"Concepts of evaluation have changed overthe years. They have changed in relation to such issues as 
who is w to be evaluated, wfiatis to be evaluated; and hotfvevajuationsj are to be made/' Evaluation 
technology has also advanced over the past two decades bringing along such techniques as the adversary. 
finodeC discrepancy.evaluation, formative evaluation, goatfree evaluation, medical model of evaluation, 
transactional evaluation, cost-benefit analysis,, eyaluability assessment and the like. Federal programs 
also havte become more responsive and receptive to the utilization of evaluation methodology. In some 
cases, thfeiesponsiveneiss of federal programs has been directed from external forces such as froni th$ 
public and from legislators as a direct result of their quest for program and fiscal accountability, as well 
as for ^demonstration of program £nd costfcenef its. * 

Jt\ the case of Title I, as an example, this external pressure for evaluation *has manifested itself • 
*n Congre^' pJea and demands of the United Sta,tes Office of Education to develop an evaluation and 
reporting System which would formalize the evaluation of Title I programs across the nation. This 
force gave rise to the devetopment of the Title I Evaluation and Reporting System (TIE RS). Although 
many state and local educational agencies far surpass TIE RS, in terms of both design and sophistication 
of their evaluation models, nonetheless, TIERS catalyzed positive movement for the field of evaluation. 
State agencies without clear jnandatefc or guidelines for program evaluation used th$ TIE RS system as 
a vehicle for evaluating not only Title I programs but other compensatory education i progfenis. In 
addition td, title J/*>ther federally funded as well as state funded ptbgjram^uring the seventies also « 
carried with v tjaem clear directives for program evaluation. Thestf evaluation set-Ssides prompted ad- 
vanipemehts fjxl movement in the overall technology of program equation. It is apparent that such 
advances would not have been possible without this type of. external stimulus or indeed pressure. 



4 l , iithef^through 1 ) normaj^maturation, 2) external/internal accountability pressures 3) fiscal 
constraints or ithe likef evaluation has-emerged into a oew decade of heightened usage and te in- 
creasingly servirjg as a catalyst forj educational policy making, for legislative action, and for management 
redirection. This catalytic function-pf evaluation is especially pivotal at state department of education , 
levels. ! . \ - ' y ^ . 

; HoweverT the current climate of the eighties prqjkices yet the strongest agent "or force tor 
evaluation efforts, i.e., shrinking fiscal resources for education spending. This decline? in thefuhding 
level acro» the breath of programs;hecessitates ever more precise pin-pointing of prggrams that are 
working or pot working — i.e., the success stories and the failures., iftcjeed, this jjrqvides, it would 
seem, a significant purpose and mission foretfaluation. r / > ' : 



L6gic*i— both from federal and" state .accountability standpoints as well as from cost-effectiveness 
and cost-hermit viewpoints — would seem to dictate the need for. evaluation and preserve the current ^ 
status and role of, evaluation. However, one must examine reality given the nature of the deregulation • 1 * ■ * 
efforts mandated 'into law in Washington^ On July 31, 1981, the .United States Congress passed the 
"Omnibus Budget Reconciliation Act of 1 981 " which provided, for significant changer in existing ' . ^ 
federal statyes. The act in essence would move towani the realization of the Reagan administration's 
goal 6f budgetary restraint and federafderegualtion of domestic programs. For the education sector, 
the ''Omnibus Budget Reconciliation. Act of 1981 " contained the "Education Cbnsolrdatibn;and : s • 
Improvement Act "of 1981." The conjalidated grants approach to allocation of funding has "reduced, * 
if not severely curtailed, reporting repositions. Cme must aste what the pbtenifal impact of the r i t 
dimished evaluation and reporting regulations will have on state agencies and on thjf* ability to monitor, 

'..If ■ ' ••' ;■ \ ' '• : v ".: • ■ 

::.<:■ • ' ;- : .',4'.:':' •./•••//• 



quality coptrol and evaluate programs at the Iota) level? All of the possibilities and potential outcomes 
are speculative at best at this point in time. Industry has, when faced with similar budget curtailmerjts, 
slashed R&D funds but maintained strong equation, quality control and quality assurance units; 
Education, when faced with similar cutbacks, does likewise respective to R & D. It regains to. be seen 
what role evaluation will play jn the reduced climate of evaluation and reporting requirements at the 
national, state ancffocal levels. I 9 1 



Rationale of a Block Grant 



Hastings (198^)rpoints out that defining a block grant is amorphous at,best. She allows for a 
1 , . range of possibilities in the funding-system taericompass oh one hahd maximum federal regulation 
# to maxinjum discretion on the part of the recipient on the other hand. c , 

Howeyer, at least five key characteristics of a block^ant have beerndentified and described 
by the Advisory Commission on I ntergroveni mental Relation* (1977) as follows which form the . 
M* n framework for the "Education Consolidation andlmproyemer^ Act of 1981 



/ 



.Federal support for a diversity of programs v ahd activities 



\ * in a broadly configured categorical area. . 

Grant recipients have latitude in defining ediicatibnaf need* 
| % # and in designing a program to respond to identified need. . 

Planning reporting, evaluation and accountably require- 
* ments are kept to a minimum? ta insure only that the optional 
j goals are being met. . *• 

< • Statutory formula for the allocation of program funds, f 1 

Eligibility jfor program participation (predefined by statute ana ^ * 
\ in general are targeted to general pj/rpose governmental units. , 

jr Given this new approach to the allocation of federal funds, prior to examining the impact the 
legislation has on evaluation and accountability /the overall advantages and disadvantages of block grants 
are printed below as described by Levin (1981). (See Figure I.) 



FIGURE I 
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COMPARISON OF ADVANTAGES VS. DISADVANTAGES OF THE BLOCK GRANT APPROACH 



* - ADVANTAGES 



DISADVANTAGES 



1 . Reduction of administrative burden and cost. 

. & 

2. Decisions made closer to those affected by them. 

». ♦ ' . 

3. Direct block grant funding reduces reporting and monitoring 
. requirements. . v * 

4. Consolidation of program personnel and procedures. 

5. Discretion of funding use within broad categorical guidelines—' 
hence more precise pinpointing of program to need area. 



CO- 
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1 1 Defeat purposes of federal aid for specified areas of educational 
need. j 

2. Allocation of funds without a specified target audience potentially 
leaves populations in need unserved. 



4. 



Block grant funds may be used to replace state and local funds 
for education* 

V 

« * _ * . 

Administrative cost savings of the block grant at the state Jevel are 
offset by increased cost factors at the local level. 
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Education Consolidation and Improvement Act of 1981 *' 

\ / Th^jEducation Consolidation and Improvement Act of 1981 w^s passed by Congress on July 31 , 
1&8'1. All chapters of the act will take effect beginning October 1 , 1982 and are authorized through 
FY1987. It was the Reagan administration's intention through the block grants to shift control over , 
educational policy away from the federal government back to state and local agencies. The budget 
authority for the block grants in 1982 will'be reduced to 8u percent of the total sum of the combined 
programs in 1981. j 

The basic components of the act which consists of three chapters is described below: 

\ - Chapter 1, "Financial Assistance to Meet Special Educational Needs of 

Disadvantaged Children/' is a rewrite of ESEA Title I. The new 
. * language, draws upon provisions in the old ES£A Title I law such as . 
K retaining the allocation formula and the emphasis on low-income 
children, but also provides som$ simplification and telaxatipn of 
previous requirements. \ • x 

Chapter 2. "Consolidation of federal Programs fbr Elementary and 
, Secondary Education/' consolidates ESEA, Titles II through VI, VIII, 
, . and IX and $uppo$irig authorizations into a single program of grants 
'S to states, to be used for the same purposes. There §re also some 
programs and profectsjo be reserved forihe Secretary of Education 's 
discretion. / I 



m • * Chapter 3. "General Provisions/' relate&io various administrative and 
. accounting requirement?, and limits both the authority of the 
Secretary to issue regulations and the legal standing of the regulations. 

Evaluation/Accountability Role Under the Education and Improvement Act of 1981 



y Traditionally, categorical programs have had a strong politicaMobby and vested interest group * 
to provide their support base. It is no secret that continued funding for these programs has been 
guaranteed not on the outcomes of the program or evaluation data but by legislation. Accountability 
is verted^ggthe cloak of regulation,guid'elines and procedure. The preservation of an intact dhapter < — * 
"Financial Assistance to Meet Special Educational Needs of Disadvantaged Children" is a manifestation 
.of the power and concern of the special interest groups for disadvantaged students. v 

- * ■ ' *M " . • " V 

4 . For block-grant programs, funds must be allocated and utilized in accordance with law, statute v 
and administrative regulation. Accountability for the block grants wtH take three basic forms: 

r ' \ 1) descriptive reporting of clients served, fiscal accounting, servibes * 

* offered.including program description and implementation process, 

2j impact (effectiveness) evaluation, and ' w A 

3) monitoring' of programs by advisory groups* m 9 ^ ■ 

Over the years, educational evaluation, accountability and reporting efforts at national, state 
and local levels jiavte matured bringing along such models as the Title I Evajuation.and Reporting t % 
.System (TIERS), the Migrant Student Record TransferlSystem (MSRTS) and many others. The * 
aforementignedare offered asonly illustrative examples without comment on technical rigor, j 
adequacy or total acceptance by the evaluation community. The point being made is that evaluation, 
accountability and program monitoring wefle coming into their own as JqoIs for enlightened decision- 
making arid program planning and redirection. The sophistication in evaluation is due primarily to . 



. rfiatura'tiorhof the field itsadf-but in no sjpall part is also due to the valuation demands placed on state 
and Focal program managers by.the powerof federal statute and regulation. Indeed, federal evaluation 

* -regulations have done much to catalyze lethargic state and local agencies iryto.more strujtfture, rigor and~ 
technicaf accuracy and adequacy with respect to evaluation planning, implementation and utilization. 

An analysis of the current provisions for evaluation and reporting in the Education Consolidation 
and Improvement Act of 1981 are minimal (see Figure 2) and pose significant evaluation problems at the 
' local, state and national levels. 9 



f IGURE 2 - 

evaluationaReporting and accountabilityxiVations 
in education consolidation and improvement act of 1981 



Chapter and Citation Number 



* Chapter 1: f^nancfal Assistance 
to meet special educationald 
" needs'of disadvantaged children 

Bee: 555 (d) 



r 



Sec. 556 (b)(4) 



Target, Area and/or Comments 



Sustained gains 



.V 

Citation 



ERIC 
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(d) VRecordsand Information. 
Each state educational agency " 
shall keep such Records and m 
s provide such information to the 
secretary as may be required for 
fiscal audit and program evalua- 
tion (consistent with the responsi- 
bilities of the secretary under this 
ch.apter). 

(b) . Application Assurances. 
The application described in sub* 
section (a) shall be approved if it* 
provides assurance's satisfactory 
. to the State educational agency 

- that the local educational ^gency 
will keep such recores and f provide 
such information \o the state % s 
education agency as mfcy be 
required for fiscal audit and- 

- program evaluation (consistant » 
•with the responsibilities of the 
state agency under this chapter), , 
and that the programs ^nd "J 
projects described. 

(4) Will be evaluated \r\ terms 
of their effectiveness in achieving"* 
the goals set for theim and that 
such evaluations shall include % 
objective measurements of . 
• educagional achievement in basic 
skjjis and a determination of ' 
whether improved performance 
is sustained over a peritfcfcS more 
than one year. 



\ 



i Chapter and Ci^tion Number 



T*rgeJ t Area and/or Comments 



Citation 



Chapter 2: Consolidation of 
Federal/Program* forElemeniar} 
'and Secondary Equation 

. Sec. 564(a)(2)(G) 



Evaluation requirements 



■ • / 



Sec. 564 (a)(5) and 
Sec. 564 (a) (6) 



Evaluation requirements and 
and effectiveness^ 
evaluation ' 



Sec. 568 (a)(3) 



Sec/ 573 (a)(5) 



Basic Ski^s Program 
effectiyenesf , . 



(G) the State Legislature: *to- 
adviie the state educational 
agenjcy on the allocation among 
authorized functions of funds 
(not to ejcceed 20 per centum 9 * 
of the amount of the state's 
allotment) reserved for state use 
under section 565(a) on the 
formula for the allocation of 
funds to local educational 
agencies and on the planning/ 
development, support, implemen- 
tation, and evaluation of state 
programs assisted under this • 
chapter. f t» 

(5) beginning with fiscal year 
1984, provides for annual eval- • 

♦uatiori of the effectiveness of 
programs assisted under this 
chapter, which sfiall include » 
comments of the advispry 
committee, and shall be made . 
available to the public and 

(6) provides that the state 
educational agency will'keep 
such records and provide sucb 
information to the secretary as 
may be required for fiscal audit 
and progrann^vatuation (consistent 
With the responsibilities of the 
secretary under this chapter)* 



(3) agrees to keep such records 
and provide such inf orrpation to 
the state educational agency as 
reasonably may jtt required for /■ 
fiscal audit andJjrogram evaluation 
consistent wittfthe responsibilities 

of the state agency under this chapte 

/ 9 



(5) procedures for testing 
students and for evaluation of the 
effectiveness of programs for 
maintaininaa continuity of effort 
for individual children, j 



Chapter and Citation Number 



Target Area'and/or Commei 



\ 



Citation 



Chapter 3: General Provisions' 
S$c. 591 (b) • 

■I' ' 



No regulations 



(b) Irfall other matters relating to 
$he details of planning, developing, 
implementing arid evaluating 
programs and projects by state 
and local educationaJ agencies 
the secretary shall not issue ' ^ 
regulations, but may consult with 
appropriate state, iocal and private 
* educational agencies and upon 

request, provide technical assistance 
/ information and suggested guidelines 
designed to promote the develop- 
ment and Implementation of - 
effective instructional programs 
and to otherwise assist in carrying 
.but the purposes of this subtitle. * 



Impact and Future Directions of Evaluation Given the Block Grant Legislation 

From a program perspective as well as from an evaluation perspective, the advent of reduced federal 
control over educational programs both from the f uijdjng^pect on throught to the accountability aspect 
must be viewed on one hand as a significant step forwai^ 

Stages and local educational agencies now havethe latitude to allocate program dollars to areas of 
need within their own parameters without adhering to prescriptive government guidelines and regulations 

* States which have clamored that their own evaluation and accountability systems were much more 
advancednhan the evaluation methods advocated by the federal government will once again be free to 
pursui these methods without the added burden of federal evaluation and reporting mandates and overlays. 
This new found flexibility permits greater evaUftbion emphasis and utility at the local- level for decision* 
making at the same time it compounds the evaluation dilemma at the state and national levels. Evaluation 
responsibilities exist for both. the federal and state.governTnents without any identified of uniform 
mechanism proposed to conduct any evaluation or indeed collect any descriptive data., Being circumspect, 
orte wonders if the lack of specificity in the block grant legislation in the evaluation area was not a 
deliberate attempt io divest'the federal funding role. for education in 1987 when the authorization. for the 
Education Consolidation and Improvement Act of 1981 ceases. Since it will be difficult at best to gather- 
national evaluative or descriptive data on ^effectiveness of the legislation, would this not be a reason 
to curtail expenditures to education? 



:hae 



Additionally, the lack of accountability on the expenditure of funds certatnly would not augur 
weil for those groups lacking in political power and lobbying sophistication who must compete with more 
powerful constituencies in this time oi inflation and budgejt pressure (Levin, 1981). * 

■* • 
Given the vast flexibility in terms of scope of program that the block grant legislation allows at the 
local level, any aggregation of evaluation data- at the state and national levels will be "primitive" at best 
unless the states adopt "comparable" evaluation and reporting practices. Such an effort is currgrjtty 
underway with ^Consolidation Evaluation Task P^rce sponsored "by the Council of Chief State School 



• * Officers (CCSSO). It is the intention of the jask force to develop an, evaluation framework for the block . . * 
• grant legislation which could hav6 application nationwide. It is hdpectthat CCSSO will'endorse such a * 4 -* 

mechanismj|s a viabie method to ensure that a common core of evaluativadata wiltbe available at- state ^ - . 
- and nationalfevels to juSmy 'program expenditure and to document program impact arid effectiveness: 

V . . • , - /H' x 

Tbe Consolidation Evaluation Task Force adwcated the follpwing five tenents asqiypance to 
developing any evaluation' system for the block grant legislation (Consolidation Evaluation Taslc£orce, , 
% 19*1-1982): ' V ' , /' " , . " ' * . 

V. Evaluations should be appropriate to the scope and nature of the activity f»* 
"» A being evaluated. Evaluatidn impapt data could continue to be summarized 

"r for Chapter I whereas the rpore varied and smaller in scope nature of ^ * ^ 

• Chapter 1 1 will require other fcyalutftive approaches. # » • * ' ' - , 

* ' - ) 1 * * " • 

.2. .-.Evaluation approaches at state and,locaNevels should be suggestive, Jf , . ^ 

* 4 * possible, states shou ld be encouraged to t cojlect a common core of 1 
; I . > descriptive program data whicft could then be reportec^at the national^ a 

level. ^ v *i+ 

3. SEAs and LEAs should ntake every effort to coHect data fpt block grant . ^ % 
supported programs to assure that funds havfe been well spent and- have 
had an "impact", for tbe target audience.* . * - 

1 ■ . ' • * 

4, The evaluation approaches currently utilized for Title I should be \ 

/ continued as evaluation approaches for Chapter I. 1 ^ H- 

, . \ • • " ' * ' \ s ' ' • • * * ' 

'5. f For Chapter I I, SEAs should collect data on the following two questions + - * 

"iflrtime to havs an effect on the federal budget f-eview process: 



^ How effectively has the block grant been implemented at the 



* state and lopal levels? ' 



ttaslKe block grant funding metihe critical identified riefedsof 
%> * # school districts? / *■ 



It remains to be seen, jf SEAs and LEAs can rise to the challenge of a creative andsresponsive 
approach to the implementation of the block grant legislation without setting back^goop svalbatidn / 
and reporting practices lightyears away. * 1 \ 
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